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IMAGE PROCESSING APPARATUS, SERVER APPARATUS , 
IMAGE PROCESSING METHOD AND MEMORY MEDIUM 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to an image 
processing apparatus for processing document data 
described in a predetermined structured description 
language utilizing such document data and externally- 
entered print setting information, a server apparatus 
capable of communication with such image processing 
apparatus, an image processing method and a program 
therefor . 

Related Background Art 

Rapid popularization of the personal computers and 
the internet in recent years has accelerated the shift 
of documents to electronic ones in every fields . 
However, since the data format of the electronic 
document depends on the application used for editing 
the document information, it is required, in order to 
view the document information in the electronic form, 
to support an application supporting the data format of 
such document information. Also there are becoming 
popular the documents described in a structured 
description language not dependent on a specific 
application, such as HTML (Hyper Text Markup Language) 
or XML (extensible Markup Language). 



The structured description language, represented 
by these languages, is designed primarily for display 
on a display image by an application in which the 
information viewing software or so-called browser or 
various HTML is supported, and lacks the concept of 
page. In case of display with the browser, the concept 
of page is unnecessary because it is possible to 
arbitrarily change the width or the height of the 
displayed image or to scroll the displayed image. On 
the other hand, in case of using the structured 
description language as a page description language, 
there is required page allotment, and the present 
invention is to meet such requirement . 

A step of converting a structured description 
language without the concept of page into a structured 
description language capable of page layout is called 
formatting. However, if the formatting into a physical 
page in fixed manner with an absolute scale such as a 
font size, there may be encountered a drawback that the 
page becomes not well legible depending on its content 
or that the layout does not match the taste of the 
user. The physical page means an output page obtained 
by printing image data on paper. Also the physical 
page includes a page outputted on a display of a host 
computer or the like by previewing the print data. 
Also in printing the structured document, a method of 
designating the font size with a HTML editor or a web 



browser in a personal computer is associated with a 
drawback that the document has to be once received by 
the host equipment, then opened by the application and 
subjected to cumbersome operations on the application 
5 in order to achieve designation of the font. 

In recent years, there are developed applications 
for editing the web browser and the HTML file, and it 
is made possible to designate the font size by the 
input means of a personal computer (PC) on the HTML 

10 document displayed by the application and executing 
page layout on the PC for transmission to a printer. 
However there remains a drawback that the base font 
size in the structured document can be set by the 
aforementioned font size designation but the font size 

15 of the characters designated individually by the author 
of the document cannot be changed. For example a 
technology of dividing a page into a table area and a 
text area and designating different font magnification 
rates respectively for these areas is incapable of 

20 obtaining a document with easily legible characters by 
unconditionally designating the font size at a 
specified size or larger. 

Also there is known a technology in which, in 
executing page layout of a document , a program 

25 calculates the magnification rate of the font applied 
to a page separated into the table area and the text 
area according to a predetermined algorithm thereby 



achieving layout. More specifically, there is known a 
technology which, in a table area, reduces the black 
area on a condition that the character train contained, 
in the entry of the table is not split into a new line, 
thereby enlarging the font so as to increase the print 
area. Also, in case the font of the text area is 
enlarged, there increases the proportion of the print 
area contained in a page. Therefore the font size of 
such text area is enlarged in such a manner that the 
print area becomes equal to or larger than a 
predetermined proportion. However, such enlargement of 
font depends on thestate of layout and the output is 
not necessarily executed in the font size designated by 
the user. For example, in case of print data with an 
originally large proportion of print area, such as a 
large table containing small characters, the program 
does not enlarge the font even if the characters are 
outputted with a small font size. Thus since too much 
emphasis is given to the proportion of the print area, 
there cannot be obtained the output with the font size 
desired by the user. 

SUMMARY OF THE INVENTION 

A first object of the present invention is to 
achieve appropriate formatting of the document 
utilizing information contained in the structured 
document and/or information relating to the physical 
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page to which the structured document is to be 
allotted. Such object can be attained, according to a 
preferred embodiment of the present invention, by the 
following configuration of outputting character 
5 information, contained in the document information 
obtained from a server apparatus, in a desired font 
size, utilizing, in analyzing the document information 
described in a predetermined structured description 
language, a font size set or designated in advance or 

10 character size information most frequently appearing in 
the document or information on the smallest character 
size appearing in the document or information on the 
maximum object width appearing in the document or 
information consisting of a combination of the 

15 foregoing. This embodiment enables layout of the 

document information described in the predetermined 
structured description language, taking a desired font 
size designated by predetermined designation means as 
the standard font size for the character or character 

20 train of the structured document. Also there can be 
provided an image processing apparatus, an image 
processing method and a program therefor, capable of 
realizing page layout of a high freedom thereby 
selecting the output according to the taste of various 

25 generations from aged persons to children. Also 

according to a preferred embodiment of the present 
invention, designation/input means for the font size is 
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provided on the image processing apparatus to achieve 
page layout by a simple input from an operation unit of 
the image processing apparatus or from a remote host 
computer to the image processing apparatus without 
operating the application such as the HTML editor on 
the PC. 

A second object of the present invention is to 
provide an image processing apparatus, a server 
apparatus, an image processing method or a program 
therefor capable of image output of various document 
information subjected to page layout with the size 
desired by the user, without the server applying the 
drawing burden on the image processing apparatus. This 
object can be attained, according to a preferred 
embodiment, by a configuration in which a font size 
designated by the user in the reference print 
instruction as print setting information is transmitted 
to the server apparatus from which the document 
information is to be obtained, and the document 
information subjected to layout in the server apparatus 
according to such print setting information is obtained 
and outputted. 

The objects of the present invention are not 
limited to those attained by the aforementioned 
embodiments, but the present invention may assume other 
configurations as long as there can be attained the 
object of obtaining a drawing output of satisfactory 



appearance in allotting the structured document to the 
physical page or obtaining a print output of 
satisfactory appearance by print instruction through a 
network. Other features and advantages of the present 
invention will become apparent from the following 
description taken in conjunction with the accompanying 
drawings, in which like reference characters desintate 
the same or similar parts throughoutthereof . 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a cross -sectional view showing the 
internal structure of a laser beam printer applicable 
to embodiments of the present invention; 

Fig. 2 is a block diagram showing the 
configuration of a printer control system constituting 
an embodiment of the present invention; 

Fig. 3 is a block diagram showing the 
configuration of data processing in an image processing 
apparatus constituting an embodiment 1 of the present 
invention; 

Fig. 4 is a view showing an example of the 
reference print instruction described in a structured 
description language in the image processing apparatus 
of the present invention; 

Fig. 5 is a block diagram showing the 
configuration of a web server capable of communication 
with theimage processing apparatus of the present 



invention; 

Fig. 6 is a view showing an example of document 
data stored in the document server shown in Fig. 5; 

Fig. 7 is a view showing an example of a style 
sheet stored in the document server shown in Fig. 5; 

Fig. 8 is a view showing an example of the 
document data converted by the process of of a layout 
data generator shown in Fig. 5; 

Fig. 9 is a flow chart showing an example of a 
first data processing sequence in the image processing 
apparatus of the present invention ; 

Fig. 10 is a flow chart showing an example of a 
second data processing sequence in the image processing 
apparatus of the present invention ; 

Fig. 11 is a flow chart showing an example of a 
third data processing sequence in the image processing 
apparatus of the present invention; 

Fig. 12 is a flow chart showing an example of a 
first data processing sequence in a server apparatus of 
the present invention; 

Fig. 13 is a flow chart showing an example of a 
second data processing sequence in the server 
apparatus ; 

Figs. 14, 15 and 16 are views showing the results 
of document data output process in the first embodiment 
of the present invention; 

Fig. 17 is a flow chart showing a data processing 



sequence in a server apparatus constituting a second 
embodiment of the present invention; 

Fig. 18 is a view showing a specific example of 
HTML document data processed in the server apparatus 
constituting the second embodiment of the present 
invention; 

Fig. 19 is a block diagram showing the 
configuration of an image processing apparatus 
constituting a third embodiment of the present 
invention; 

Fig. 20 is a flow chart showing an example of a 
fourth data processing sequence in the image processing 
apparatus of the present invention; 

Fig. 21 is a view showing the memory map of a 
memory medium storing various data processing programs 
readable by a print system in which the image 
processing apparatus or the server apparatus of the 
present invention is applicable; 

Fig. 2 2 is a view showing an example of a document 
information displaying image by a browser; 

Fig. 23 is a view showing an example of the print 
output of the document shown in Fig. 22; 

Fig. 24 is a flow chart showing a formatting 
process in a fourth embodiment; 

Fig. 25 is a flow chart showing a formatting 
process in a fifth embodiment; 

Fig. 2 6 is a flow chart showing a formatting 
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process in a sixth embodiment; 

Fig. 27 is a view showing an example of document 

data described by HTML; 

Fig. 28 is a view showing an example of print 
5 after formatting in the fourth embodiment; 

Fig. 29 is a view showing an example of document 

data after formatting in the fourth embodiments- 
Fig. 30 is a view showing an example of document 

data after formatting in the fifth embodiment; 
0 Fig. 31 is a view showing an example of document 

data after formatting in the sixth embodiments- 
Fig. 32 is a view showing an example of print 

after formatting in the fifth embodiments- 
Fig. 33 is a view showing an example of print 
5 after formatting in the sixth embodiment; 

Fig. 34 is a flow chart showing a formatting 

process in a seventh embodiment; 

Fig. 35 is a flow chart showing a figure/image 

processing shown in Fig. 34; 
0 Fig. 36 is a flow chart showing a formatting 

process in an eighth embodiment; 

Fig. 37 is a view showing a document displayed by 

web browser; 

Fig. 38 is a view showing an example of print 
5 result by applying a magnification rate taking 

character only into considerations- 
Fig. 39 is a view showing an example of print 



result in the eighth embodiment ; 

Fig. 40 is a view showing an example of reference 
print instruction in the eighth embodiment; 

Fig. 41 is a view showing an example of print 
result in the eighth embodiment; and 

Fig. 42 is a view showing a part of the image 
displayable on an operation panel 1012. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Now the present invention will be clarified in 
detail by preferred embodiments thereof, with reference 
to the accompanying drawings. At first there will be 
explained, with reference to Fig. 1, the configuration 
of a laser beam printer (LBP) suitable for application 
of the embodiments. However the embodiments are 
applicable not only to a laser beam printer but also 
any other printers capable of forming and outputting an 
image. For example, there can naturally be employed a 
copying machine, a facsimile apparatus or an ink jet 
printer. Also the output means in the present 
invention not only includes the print output by a 
printer but also previewing in a display unit of the 
printer. Also the image processing apparatus naturally 
includes not only a printer but also an image 
processing controller provided therein or a computer 
provided with a software capable of formatting process. 
In the following there will be explained embodiments of 
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the present invention with reference to the 
accompanying drawings . 
First Embodiment 

Fig. 1 is a cross -sectional view showing the 
5 internal structure of a laser beam printer which is 
applicable to the present embodiment and to which 
character patterns or a fixed format (format data) can 
be registered from an unrepresented data source. 

Referring to Fig. 1, a main body of the laser beam 

10 printer (hereinafter simply called printer) receives 

and memorizes character information (character codes), 
form information, macro instructions etc. supplied from 
an externally connected host computer, prepares 
corresponding character patterns or form figures 

15 according to such information and forms an image on a 
recording sheet constituting a recording medium. 

An operation panel 1012 is provided with switches 
for operation and an LED display unit, and is capable 
of entering for example print set information to be 

20 explained later. A printer control unit 1001 controls 
the entire printer 1000 and analyzes the character 
information supplied to a host computer. The printer 
control unit 1001 converts principally character 
information into a video signal of a corresponding 

25 character pattern for supply to a laser driver 1002 

which serves to drive a semiconductor laser 1003. The 
laser driver 1002 executes on/off control of a laser 



light 1004 emitted from the semiconductor laser 1003 
according to the entered video signal. The laser 
lilght 1004 is deflected laterally by a rotary polygon 
mirror 1005 for scanning an electrostatic drum 1006. 
5 Thus there is formed an electrostatic latent image 

of the character pattern on the electrostatic drum 
1006. The latent image is developed by a developing 
unit 1007 provided around the electrostatic drum 1006 
and then is transferred onto a recording sheet, 

10 consisting of a cut sheet. The recording cut sheet is 
contained in a sheet cassette 1008 mounted on the 
printer 1000, then fetched into the apparatusby a sheet 
feeding roller 1009, and conveying rollers 1010, 1011 
and supplied to the electrostatic drum 1006. 

15 Fig- 2 is a block diagram showing the 

configuration of a printer control system embodying an 
embodiment of the present invention. The present 
embodiment will be explained by a laser beam printer 
(Fig. 1). However the present invention is naturally 

20 applicable to a single equipment, a system consisting 

of plural equipment or a system in which the process is 
executed through a network such as a LAN as long as the 
function of the present invention can be attained. 
Referring to Fig. 2, a host comoputer 3000 has 

25 following functions. There is provided a CPU 1 for 

executing fetching of document data and data conversion 
according to a document processing program or the like 
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stored in a program ROM of a ROM 3, and the CPU 1 
collectively controls the devices connected to a system 
bus 4 . The program ROM of the ROM 3 also stores the 
control program etc. of the CPU 1. A font ROM of the 
5 ROM 3 stores font data etc. to be used in the 

aforementioned daeta conversion process . A data ROM of 
the ROM 3 stores various data to be used in the 
aforementioned data conversion process. 

A RAM 2 is used as a main memory and a work area 
10 for the CPU 1. A keyboard controller (KBC) 5 controls 
the input from a keyboard (KB) 9 and an unrepresented 
pointing device. A CRT controller (CRTC) 6 controls 
the display on a CRT display (CRT) 10. The CRT may 
also be used for previewing the result of layout 
15 process of the structured document to the physical 

page. The layout process of the structured document 
will be explained later. 

In the present embodiment, the keyboard 9 and the 
CRT display 10 are not indispensable, but they are 
20 usually provided for the purpose of maintenance of the 
server computer and confirming the operation status 
thereof. As will be explained later, the CRT display 
10 may be used for designating the font size to the 
printer 1000 as shown in Fig. 42. 
25 A memory controller (MC) 7 controls the access to 

an external memory 11, which stores a boot program, 
various applications, font data, user files, editing 



files etc. The external memory 11 may be composed of a 
hard disk (HD) , a floppy disk (FD) , or any other memory 
medium capable of holding program and/ or data. 

A network controller (NTC) 8 is connected to the 
5 printer 1000 through a predetermined bidirectional 
interface (interface) 21 and executes communication 
control with the printer 1000 . The CPU 1 can fetch the 
document data stored in the external memory 11 by 
controlling the memory controller 7 and can transfer 

{Z t 10 the document data to the exterior by controlling the 

Jr: network controller 8 . 

Jjf In the printer 1000, there is also provided a 

s __ printer CPU (CPU) 12 for collectively controlling the 

-S devices connected to a system bus 15 based on a control 

|=i= 

ITU 15 program stored in a program ROM contained in a memory 

b& unit 13 or a control program stored in an external 

memory 14 and outputs an image signal constituting 
output information to a printer engine 17 connected 
through a print unit interface 16. The memory unit 13 
20 is often composed of a ROM for storing data such as 
programs or font data but may also be composed of 
another memory medium such as a small hard disk drive 
(HDD) or a detachable memory card. 

The program ROM of the memory unit 13 may also be 
2 5 used for storing a control program for theCPU 12 as 
will be shown in a following flow chart. 

A font ROM of the memory unit 13 is used for 
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storing font data etc. to be used in generating the 
aforementioned output information. Also a data ROM of 
the memory unit 13 stores information to be used on the 
host computer 3000 in case of a printer lacking the 
5 external memory 14 such as a hard disk. 

A CPU 12 is rendered capable of communication with 
the host computer through an input unit 18 and also of 
informing the host computer 3000 of information in the 
printer. 

10 A RAM 19 functions as a main memory and a work 

area for the CPU 12 and is so constructed that the 
memory capacity can be expanded by an option RAM 
connected to an unrepresented expansion port. 

The RAM 19 can be used as an output information 

15 development area, an environment data storage area, an 
NVRAM etc. The access to the aforementioned external 
memory 14 such as a hard disk (HD) or an IC card is 
controlled by a memory controller (MC) 20. The 
external memory 14 is connected as an option and is 

20 used for storing document data, font data, form data 
etc. 

The aforementioned control panel 1012 is provided 
with switches for operation and an LED display unit. 

Also the aforementioned external memory is not 
2 5 limited to one unit but can be provided in one or 

plural unit including an optional font card for the 
fonts in addition to the internal fonts or external 



memories storing a program for analyzing a printer 
control language of a different language system. Also 
there may be provided an unrepresented NVRAM for 
storing the printer mode set information entered from 
the operation panel 1012. 

Fig. 3 is a block diagram showing the 
configuration of data processing in the image 
processing apparatus constituting a first embodiment of 
the present invention. 

Referring to Fig. 2, the printer 1000 is 
principally composed of a formatter controller 1100, a 
printer interface 1200, an output controller 1300, and 
a printer engine 1400. 

The formatter controller 1100 is composed of a 
protocol controller 1101, a data discriminator 1102, a 
document data analyzer 1103, a data drawer 1104, a page 
memory 1105, and a reference print processor 1106. 

The printer interface 1200 is used for 
input /output with the exterior. The protocol 
controller 1101 executes communication with the 
exterior by analyzing and transmitting network 
protocol, and, in case of employing HTTP (Hyper Test 
Transfer Protocol) for the protocol, executes 
acquisition of a document designated by URI (unified 
resource identifier) or transmission of information to 
the web server. For the URI, there can be designated 
an URI capable of indicating the presence of the 



resources on the network. In the printing operation, a 
resource on the web server is designated in the 
reference print command. A device receiving 
thereference print command executes processing by 
5 acquiring the resource from the URI . 

The data discriminator 1102 discriminates whether 
the received data are a reference print command or 
document data, and, respectively if the received data 
are discriminated as a reference print command or 

10 document data, the data are respectively transferred to 
the reference print processor 1106 or to the document 
data analyzer 1103. 

The reference print processor 1106 extracts 
various information from the reference print command 

15 and transmits the necessary information to the exterior 
through the protocol controller 1101. The reference 
print command, of which a specific example will be 
explained later, is capable of acquiring a document by 
transmitting for example the URI of the document and 

20 the print set information. 

In case the data received by the image forming 
apparatus are known in advance not to be a reference 
print command but to be document data, there can be 
conceived an embodiment in which the reference print 

25 processor 1106 and/or the data discriminator 1102 is 
dispensed with. 

The document data analyzer 1103 analyzes the 



document data described by the structured description 
language and executes conversion into intermediate 
codes of a more easily processible format. The 
intermediate codes generated in the document data 
5 analyzer 1103 are transferred to and processed by the 
data drawer 1104. 

The data drawer 1104 develops the aforementioned 
intermediate codes into bit map data, which are drawn 
in succession in a page memory 1105. The formatter 

10 controller 1100 is generally composed of a computer 
system employing a CPU, a ROM, a RAM etc. 

The output controller 1300 converts the content of 
the page memory 11005 into a video signal and transfers 
the image to the printer engine 1400, which is a 

15 printing mechanism for forming a permanent visible 
image of the received video signal on a recording 
sheet . 

Fig. 22 shows an example of the document 
information display image by a browser stored for 

20 example in the document server 2004 and corresponds to 
a state where a document described by a structured 
description language without the concept of page is 
displayed by the browser. Also Fig. 23 shows an 
example of the print output of the document shown in 

25 Fig. 22. 

As shown in Fig. 22, in the general browser, it is 
possible to change the size of the displayed image or 
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to scroll the image in the vertical or horizontal 
direction by a scroll bar. Fig. 2 3 shows an example of 
the document described in the structured description 
language after formatting. In this mannere the 
5 document after formatting can be displayed or printed 
in the unit of a page. 

On the other hand, since the document described by 
the structured description language does not require a 
particular application as explained in the foregoing, 
10 the printing is possible from a terminal not supporting 
the application if there is a printing apparatus 
capable of analyzing the structured description 
language . 

In the following there will be explained a 
15 technology for executing page layout on the document 
data described in the structured language as shown in 
Fig. 22 and executing output as shown in Fig. 23, by an 
example of reference printing. The document 
information on the web server can be printed by 
20 instructing the storage position of the document to the 
printing apparatus , for example from a portable 
information terminal or a portable telephone. Such 
print instruction is called a reference print 
instruction, which will be explained in more details 
25 with reference to Fig. 4. Fig. 4 shows an example of 
the reference print instruction, which is a print 
command including information on the location of the 



structured document to be subjected to page layout. 
The print command shown in Fig. 4 is described by the 
structured description language from a host (not shown 
in Fig. 4) to the printer 1000, but it need not 
necessarily be described by a structured description 
language . 

In Fig. 4, a first row indicates that the data are 
not document data but a reference print instruction. 
The document data to be actually printed are desginated 
by the URI in a second row. The URI is the most common 
method for designating a document on the internet and 
will not, therefore, be explained in detail, but the 
second row is to request, by the HTTP protocol, a 
document entitled "mydocument" stored in the web server 
of a name "myserver . dom" . 

A third row designated the size of the output 
sheet. An A4-sized sheet is designated in the 
illustrated case. A fourth row designates the 
direction of layout . A portrait direction is 
designated in the illustrated case. A fifth row 
designates the base font size. An 8-point (8 pt) size 
is designated in the illustrated example. The base 
font size used herein is different from the standard 
font size to be explained later. The base font size is 
a font size constituting a base that can be defined in 
the structured document. If the font size is not 
designated, the display is ususally made with such base 
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font size. Also in the structured document of the 
present embodiment, a display format instruction which 
designated the display format such as the desired font 
size or font style is defined in the form of a tag. 
5 Also a style sheet constitutes a portion where the user 
can independently define the information indicating the 
output format (for example font size, font style, 
Italic, underlined etc.) of the character information. 

By applying such tag to a specified character or a 
10 specified character train in the structured document, 
such applied character or character train in the 
structured document is outputted in the form defined in 
the style sheet. The style sheet in the present 
invention is taken in the wide sense including a style 
15 applied by the formatter by automatic reading whenever 
necessary even without explicit instruction by the 
user. In the formatting process, the style sheet if 
provided is read simultaneously with the structured 
document for analyzing and outputting the tag 
2 0 information. The base font size in the present 

invention may also be defined in the style sheet, and 
is a default character size applied to a character or a 
character train unless another font size is instructed 
therefor. The structured document, if directly 
25 subjected to page layout, often contains information 

designating the font size. The command designating the 
font size can also be represented by a tag format, for 



example, in the HTML, by a character train </Hl> 
indicating a title <H1> (this tag format indicates a 
larger title). If no font size is designated, the 
character train is usually outputted with the base font 
size. The object of the present invention is to output 
the character or the character train of the structured 
document with a desired font size (hereinafter called 
standard font size) designated by predetermined 
instruction input means . The instruction input means 
can be, for example, the operation panel 1012 of the 
printer 1000 or the input unit 18 of the printer 1000 
receiving the input of instruction from the host 
computer 3000 through the network. 

The document "my document" can be printed on a 
physical sheet by transmission of such simple 
instruction to the printing apparatus, without direct 
transmission of the document data thereto. 

Fig. 5 is a block diagram showing the 
configuration of a web server capable of communication 
with the image processing apparatus of the present 
invention . 

Referring to Fig. 5, the web server 2000 is 
principally composed of a web server interface 2001, a 
protocol controller 2002, a layout data generator 2003 
and a document server 2004. 

The web server 2001 executes input/output with the 
exterior. The protocol controller 1101 executes 
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communication with the exterior by analyzing and 
transmitting the network protocol, and, for example in 
case of employing HTTP as the protocol, executes 
reception of information and transmission of the 
document designated by the URI . The layout data 
generator 2003 executes page layout of the document 
stored in the document server 2004. 

The document server 2004 stores the document file 
described in the structured description language. For 
example the document data stored as a structured 
document in the document server 2004 are displayed by 
the web browser as shown in Fig. 22. Such document 
data are subjected to page layout by the layout data 
generator 2003 to generate layout data as shown in Fig. 
23. Upon receiving the URI and the print set 
information from the printer 1000, the web server 2000 
extracts the designated document from the document 
server 2004 and causes the data generator 2003 to 
execute page layout according to the designated print 
set information and to transmit the generated document 
data to the printer 1000. 

The printer 1000 and the web server 2000 are 
connected through a network such as Internet . 

In the following there will be explained, with 
reference to Figs . 6 to 9 , an example of the document 
data stored in the document server 2004 and those 
generated by the layout data generator 2003. 
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Fig. 6 shows an example of the document data 
stored in the document server 2004 shown in Fig. 5 and 
described in XML. 

Referring to Fig. 6, the document data are merely- 
showing the meaning of data by tagging thereto and 
cannot be subjected to page layout. 

For example, in the third row, a tag <title> is 
attached to a character train data "Sample". Such tag 
means that the character train "Sample" is a "title" 
but does not include information on the size and 
position of layout. 

The mode of layout of such document data is 
generally determined by applying a file called style 
sheet and describing the layout information. 

Fig. 7 shows an example of the style sheet stored 
in the document server 2004 shown in Fig. 5, and, in 
the document data shown in Fig. 6, the top row 
designates the style sheet to be applied. Such style 
sheet may be stored in the document server 2004 or in 
the printer 1000 shown in Fig. 3. 

In Fig. 7, second and third rows define the layout 
of "title". More specifically there is given a 
definition <font size = big font color = red position = 
center) , indicating that the title is to be positioned 
at the center of a row with a large-sized red-color 
font. Thus the document server 2000 stores the 
document data shown in Fig. 6 and the style sheet shown 
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in Fig. 7. 

Fig. 8 shows an example of the document data to be 
converted by the process of the layout data generator 
2003 shown in Fig. 5, and corresponds to an example of 
the document data converted according to the document 
data shown in Fig. 6 and the style sheet shown in Fig. 
7. 

The example shown in Fig. 8 shows document data of 
a layout in a physical page, including the character 
size and the drawing position. For example the "title" 
shown in Figs. 6 and 7 are drawn with a size of 24 
points in a position (x, y) = (100, 0)(mm). 

In the following there will be explained the 
entire print control sequence of the present embodiment 
in the print system including the image processing 
apparatus and the server apparatus of the foregoing 
configuration, with reference to flow charts shown in 
Figs. 9 to 13. 

Fig. 9 shows the process in the printer 1000 
constituting an embodiment of theprocess in the image 
processing apparatus of the present invention. Fig. 9 
is a flow chart showing an example of a first data 
processing sequence in the printer 1000, and 
corresponds to a main process sequence from the start 
of the operation to the end thereof in the printer 1000 
shown in Fig. 3, wherein S501 to S506 indicate process 
steps . 
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At first a step S501 receives the data from the 
network through the printer interface 1200. If the 
document data are present in the printer 1000 in 
advance, the process of the step S501 can be naturally 
5 dispensed with. Then a step S502 analyzes the 

protocol, and a step S503 discriminates whether the 
received data are a reference print instruction, and, 
if not, the sequence proceeds to a step S505 for 
executing a drawing operation, but, if the received are 

10 discriminated as a reference print instruction, the 
sequence proceeds to a step S504 for executing a 
document acquiring process and then a drawing procewss. 
Thereafter a step S506 discriminates whether the 
document data have ended, and, if ended, the printing 

15 operation is terminated, but, if not, the process from 

the step S501 is repeated. If the received data do not 
support the reference print instructing function, the 
process of the step S503 may naturally be omitted. 

Fig. 10 is a flow chart showing an example of a 

20 second data processing sequence in the image processing 
apparatus of the present invention and corresponding to 
the details of the drawing process (actual printing 
process) in the step S505 shown in Fig. 9, wherein S601 
to S608 show process steps. 

25 At first in a step S601, the document data 

analyzer 1103 discriminates whether the tag is a page 
end tag, and, if affirmative, the sequence proceeds to 
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a step S606 for processing such tag. 

On the other hand, if the step S601 identifies 
that the tag is not a page end tag, a step S602 
discriminates whether the analyzed tag requires a 
5 developing process into the page memory such as a 

character printing or a figure drawing, and, if not, 
the sequence proceeds to a step S605 for executing a 
process such as attribute setting or print position 
control according to the tag. 
10 On the other hand, if the step S602 identifies 

that the tag requires development into the page memory, 
the sequence proceeds to a step S603 for generating 
intermediate codes for easier development into a bit 
map. 

15 Then, in a step S604, the data drawer 1104 

executes a developing process into the page memory 1105 
in response to such intermediate codes . After the 
development process , the sequence returns to the step 
S502 shown in Fig. 9 for repeating the analyzing 

20 process for the document data. 

On the other hand, if the step S601 identifies a 
page end tag, the sequence proceeds to a step S606 in 
which the output controller 1300 converts the content 
of the page memory 1105 into a video signal for the 

25 printer engine 1400 and executes image transfer. 

Then, in a step S607, the printer engine 1400 
executes printing by forming a permanent visible image 
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of the received video signal on a recording sheet. 
Then a step S608 discharges the print result whereupon 
the print control process for a page is terminated. 
Fig. 11 is a flow chart showing an example of a third 
data processing sequence in the image processing 
apparatus of the present invention and corresponding to 
the details of the document acquiring process (process 
of acquiring the document to be printed) in the step 
S504 shown in Fig. 9, wherein S701 to S706 show process 
steps . 

At first a step S701 searches the print set 
information described in the reference print 
instruction. In the example shown in Fig. 4, the "A4" 
sheet size, the "portrait" layout direction and "8 
points" which is a font size instructed or entered into 
the predetermined instruction input means correspond to 
the print set information. The print set information 
means information to be referred to at the output in 
the printing apparatus or information to be used in 
formatting of the document data into the physical page 
by the image processing apparatus , and includes , for 
example, the font size, resolution of the print, 
effective print area, size of the output sheet, 
printing direction, one-side or two- side printing 
setting, information for reducing the toner amount, and 
information on the finishing process such as presence 
or absence of stapling. 
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Then a step S702 searches the URI described in the 
reference print instruction. In the example shown in 
Fig. 4. "http: //myserver. com/mydocument " corresponds 
to such URI . 

Then the sequence proceeds to a step S703 for 
converting the detected URI and the print set 
information into the HTTP format, whereby the 
preparation for information transmission is completed. 
The above-described steps are executed in the reference 
print processor 1106 while the following steps are 
executed by the protocol controller 1101. 

Then a step S704 searches the web server 2000 
designated by the URI, and a step S705 transmits a file 
acquisition request to the web server 2000 by the HTTP 
protocol. Then a step S706 receives (acquires) the 
document data transferred from the web server 2000, 
whereupon the sequence is terminated. 

Fig. 12 is a flow chart showing an example of a 
first data processing sequence in the server apparatus 
of the present invention and corresponding to a main 
process sequence from the start to the end of the 
operation of the web server 2000 shown in Fig. 5, 
wherein S801 to S806 show process steps. 

At first step S801 receives the data from the 
network by the HTTP protocol. This process is executed 
by the web server interface 2001. 

Then a step S802 fetches the document information. 
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designated by the URI , from the document server 2004, 
and a step S803 acquires the resources required for 
layout. The style sheet shown in Fig. 7 constitutes 
such resource required for the layout. 
5 Then a step S804 detects the print set information 

informed by the HTTP protocol, and a step S805 executes 
the formatting process. More specifically, the step 
S805 executes the actual page layout process 
(formatting process) on the physical page, utilizing 

10 the information and resources collected in the steps 
S802 to S804 and required for the page layout. 

When the formatting process in the step S805 is 
completed, the sequence proceeds to a step S806 for 
transmitting the document data subjected to the page 

15 layout on the physical page, whereupon all the process 
is terminated. 

Fig. 13 is a flow chart showing an example of a 
second data processing sequence in the server apparatus 
of the present invention and corresponding to the 

20 details of the formatting process (layout process to 
the physical page) shown in Fig. 12, wherein S901 to 
S907 show process steps. 

The printer executes processing, utilizing the 
document data described in the structured description 

25 language, the font size information in the 

aforementioned document data and the font size entered 
by the user and to be set in the character information 
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at the page layout of the document data. For example, 
the aforementioned font size information includes a 
minimum font size set for the characters contained in 
the structured document, a most frequent font size 
5 appearing most frequently therein, or a base font size 
which is a default font size set for the structured 
document to be processed. Hereinafter, a font size 
entered by the user from the input unit of the printer 
or the host computer and to be used for a character 

10 indicated by the character information contained in the 
document information at the output on the sheet or on 
the print preview image is called the standard font 
size. A character train to which specified font size 
information is applied is recognized by analyzing 

15 means, and the character train to which such font size 
information is applied is outputted with the . standard 
font size entered by the instruction input means. The 
font size information means information on the font 
size contained in the structured document to be 

20 processed. Even if the font size information is 

applied, the printer executes page layout and output of 
the character or the character train with thus set 
desired font size. Also at the page layout, the 
standard font size to be set on a character indicated 

25 by the character information is designated by the 

predetermined instruction input means. The instruction 
input means includes an input unit capable of 
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designating the font size such as the operation panel 
1012 of the printer 1000 or a keyboard KB 9 of the host 
computer connected to the printer 1000 . The standard 
font size can be entered from a remote location by 
utilizing the host computer 3000 in which mounted is a 
software for controlling the printer 1000. It is also 
conceivable to store in the memory unit 13 of the 
printer, prior to the layout process, for example at 
the forwarding from the manufacturing factory or at the 
installation of the printer. The instruction means may 
also include selection instructing means (not shown) 
for reading the information (plural) indicating the 
font sizes and stored in such memory unit 13 and 
smanually or automatically selecting the information 
(singular) indicating the desired font size by 
selection means from such font-size indicating 
information (plural) . Such selection instructing means 
may be provided in the printer or in the host computer. 
Also the font size information in the document data is 
similarly selected or set in the memory unit 13 by the 
host computer or the printer 1000 in advance or in 
interactive manner. 

In the following there will be explained the flow 
of the aforementioned process. At first a step S901 
searches a character to which applied is the base font 
size indicating the base of the font size the document. 
In the present embodiment, it is assumed that the 
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character or character train is selected in advance by 
"base font size" from the operation panel 1012 of the 
printer or the input unit of the host computer, as 
shown in Fig. 42. In the example shown in Fig. 4, the 
5 "base font size" described in the document, namely the 
character of 8 points corresponds to the base font 
size. Then a step S902 so sets that the character or 
character train to which the"base font size" is applied 
becomes the standard font size designated from the 

10 operation panel 1012. More specifically, if the 

standard font size designated from the operation panel 
1012 is 10 points, there is executed a scaling 
operation of converting the character of 8 points into 
that of 10 points. It therefore becomes unnecessary, 

15 in changing the structured document, to activate an 
application each time in the host computer, and the 
user is merely required to set the font size by the 
operation panel of the printer and to transmit the 
structured document to the image processing apparatus. 

20 Then a step S903 starts the physical layout 

process, thereby allotting the document data in 
succession to physical pages. Then a step S904 
discriminates whether the document data contain a 
character, and it not, the sequence proceeds to a step 

25 S905. 

On the other hand, if the step S904 identifies 
that a character is contained, a step S905 calculates 



- 35 - 



the font size to be outputted in consideration of the 
proportion with the standard font size, and a step S906 
continues the layout to the physical pages. For 
example a character of 12 points is shifted to a size 
5 of 12 x (10/8) points. In this manner the process from 
the step S904 is repeated until a step S907 detects an 
end tag for the document data, and the process is 
terminated when the end tag is detected. 

In the following there will be explained, with 

10 reference to Figs. 14 to 16, specific examples of the 
output results in the present embodiment. 

Figs. 14 to 16 show the results of the document 
data outputprocess in the first embodiment of the 
present invention, wherein Fig. 14 shows an example of 

15 display by the browser of a document described by a 

structured description language lacking the concept of 
page, while Fig. 15 shows the result of output when the 
standard font size is designated at "8 points", and 
Fig. 16 shows the result of output when the standard 

20 font size is designated at "12 points". 

The characters are larger and amply spaced as 
shown in Fig. 15 when the standard font size is set at 
8 points. On the other hand, when the standard font 
size is set at 12 points, it is desirable to employ a 

25 more compact layout as shown in Fig. 16. 
Second embodiment 

In the foregoing first embodiment, there has been 
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explained a case of employing XML as the description 
language for the document stored in the document server 
2004. In the present embodiment, there will be 
explained a case of employing HTML with reference to 
5 Figs. 17 and 18. 

Fig. 17 is a flow chart showing the data 
processing sequence of the server apparatus in a second 
embodiment of the present invention and corresponding 
to the main process from the start tothe end of the 

10 operation of the web server 2000, wherein S1601 to 
S1605 show process steps. 

At first a step S1601 receives the data from the 
network by the HTTP protocol. This process is executed 
by the web server interface 2001. 

15 Then a step S1602 fetches a document designated by 

the URI from the document server 2004. In the 
foregoing first embodiment, there is executed a process 
for acquiring the resource required for layout, but 
this process is unnecessary in the present embodiment 

20 since HTML contains the layout information. Then a 

step S1603 detects the print set information informed 
by the HTTP protocol, and a step S1604 executes a 
formatting process. Thus the layout process on the 
actual physical page is executed solely by the 

25 information in the steps S1602 and S1603. 

The formatting process in the step S1604 is 
similar to that in the first embodiment and will not. 
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therefore, be explained further. 

When the process in the step S1604 is completed, 
the sequence proceeds to a step S1605 to transmit the 
document after the layout on the physical page by the 
HTTP protocol, whereupon all the processes are 
terminated. 

A specific example of the HTML document data 
employed in the present embodiment . 

Fig. 18 shows a specific example of the document 
data by HTML, to be processed by the server apparatus 
in the second embodiment of the present invention. 

In Fig. 18, a <HI> tag in the third row defines 
the display in the largest font. Since HTML contains 
the layout information in the description language 
itself in this manner, the process sequence can be 
simplified in comparison with that of the first 
embodiment . 
Third embodiment 

In the foregoing first embodiment, there has been 
explained a case of executing the formatting process in 
the web server. In the present embodiment, there will 
be explained a case of executing the formatting process 
in the printing apparatus, with reference to Figs. 19 
and 20. 

Fig. 19 is a block diagram showing the 
configuration of an image processing apparatus in a 
third embodiment of the present invention, wherein 
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components similar to those in Fig. 3 are represented 
by like numbers . 

Referring to Fig. 19, a printer 1000 is 
principally composed of a formatter controller 1100, a 
5 printer interface 1200, an output controller 1300 and a 
printer engine 1400. 

The formatter controller 1100 is composed of a 
protocol controller 1101, a document data analyzer 
1103, a data drawer 1105, a page memory 1105 and a 
10 physical layout processor 1107. 

The printer interface (printer I/F) 1200 executes 
input /output with the exterior. 

The protocol controller 1101 executes 
communication with the exterior by analyzing and 
15 transmitting the network protocol. The physical layout 
processor 1107 executes allotment of the structured 
description language, namely the formatting process. 

The document data analyzer 1103 analyzes the 
document data described by the structured description 
20 language and executes conversion into intermediate 
codes of a more easily processible format. The 
intermediate codes generated in the document data 
analyzer 1103 are transferred to and processed in the 
data drawer 1104. 
25 The data drawer 1104 develops the aforementioned 

intermediate codes into bit map data, which are drawn 
in succession in a page memory 1105. The formatter 
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controller 1100 is generally composed of a computer 
system employing a CPU, a ROM, a RAM etc. The output 
controller 1300 converts the content of the page memory 
1105 into a video signal and transfers the image to the 
5 printer engine 1400. 

The printer engine 1400 is a printing mechanism 
for forming a permanent visible image of the received 
video signal on a recording sheet . 

Fig. 20 is a flow chart showing an example of a 

10 fourth data processing sequence in the image processing 
apparatus of the present invention, and corresponding 
to a main processing sequence from the start of the 
operation to the end thereof of the printer 1000 of the 
present embodiment shown in Fig. 19. In process steps 

15 S2201 to S2205, a formatting process in a step S2203 
and a drawing process in a step S2204 are similar to 
those in the first embodiment and will not, therefore, 
be explained in detail. 

At first a step S2201 receives the data from the 

20 network through the printer interface 1200 . Then a 
step S2202 analyzes the protocol, and a step S2203 
executes the formatting, namely the allotment to 
physical pages. Thereafter a step S2204 executes the 
drawing process. 

25 Then a step S2205 discriminates whether the 

document data have ended, and, if ended the printing 
operation is terminated. 
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On the other hand, if the step S2205 identifies 
that the document data have not ended, there is 
repeated the process from the step S2201. 

In the foregoing first embodiment, the base font 
5 size is designated by the reference print instruction, 
but it may also be designated by another method such as 
the designation from the operation panel. 

Also in the third embodiment, the base font size 
may be designated together with the document data. 
10 For example in case the base font size is attached 

in advance to the document data, it can be set as an 
initial value in case the base font size is not 
designated. 

In the foregoing first to third embodiments, the 
15 standard font size for the page layout is designated by 
a point size, but such font size may be simplied for 
example to "large", "medium" and "small". Such 
configuration may be realized for example by setting in 
advance correlations of "large" = 8 points, "medium" is 
20 10 points and "small" is 12 points. 

Also in the foregoing first embodiment, there has 
been explained a case of describing thereference print 
instruction by the structured description language, but 
such description need not necessarily be in the 
25 structured description language as long as it instructs 
the outputof the document data of the structured 
description language. For example the instruction can 



be made solely by the HTTP protocol. 

Also in the first embodiment, there has been 
explained a case where the document server is a 
component constituting the web server, but the document 
5 server may be provided externally, for example as a 
hard disk of another personal computer. 

Also in the first embodiment, the information 
relating to the physical page layout is informed from 
the information designated by the reference print 
10 instruction, but there may also be informed information 
that is designated in the reference print instruction 
as long as such information is referred to at the 
layout operation. 

For example the resolution specific to the 
15 printing apparatus may be informed for executing more 
rigorous physical page layout. 

Also the foregoing first to third embodiments may 
be combined to realize a configuration capable of 
switching the process according tothe difference in the 
20 resources of the server apparatus or in thedata 
processing ability thereby achieving efficient 
development and high-speed printing of the document 
information designated by the user. 

The present invention also includes constructing a 
25 print system from an image processing apparatus and a 
server apparatus provided with various means relating 
to the present invention or from an image processing 
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apparatus and a server apparatus capable of executing 
the process steps. In this manner there can be 
provided a print system capable, by formatting on an 
arbitrarily designated character size as a base, of 
5 realizing page layout of high freedom, thereby 

selecting outputs according to the taste of various 
generations from the aged persons to children. 

In the following there will be explained, with 
reference to a memory map shown in Fig. 21, the 
10 configuration of a data processing program readable by 
a print system in which the image processing apparatus 
and the server apparatus of the present invention are 
applicable . 

Fig. 21 shows a memory map of a memory medium 
15 storing various data processing programs readable by 
the print system in which the image processing 
apparatus and the server apparatus of the present 
invention are applicable. 

Though not particularly illustrated, there may 
20 also be stored information for managing programs stored 
in the memory medium, such as version information or 
author, and information on the operating system etc. 
dependent on the program reading side, for example an 
icon for identifying the program. 
25 Also data belonging to various programs are 

managed by the above-mentioned directory. There may 
also be stored a program for installing various 
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programs into the computer and a decompressing program 
in case the programs to be installed are compressed. 

In the analysis of the document information 
described in the predetermined structured description 
5 language, the document information acquired from the 

server apparatus is allotted to the physical page based 
on the designated font size. It is therefore possible 
to execute layout of the document information described 
with the predetermined structured description language, 
10 utilizing the specified character size designated by 

the user as the base, thereby realizing page layout of 
high freedom and selecting outputs according to the 
taste of various generations from the aged persons to 
children . 

15 Also since the font size designated by the user is 

transmitted as the print set information, in addition 
to the reference print instruction, to the server 
apparatus where the document information is to be 
acquired and the document information subjected to 

20 layout in such server apparatus according to such print 
set information is acquired and outputted, there can be 
outputted the document information in various page 
layouts according to the taste of the user, without 
applying a burden of drawing on the image processing 

25 apparatus. 

It is therefore rendered possible to execute the 
page layout of the document information, in the image 



processing apparatus or in the server apparatus, in 
which the size of each character in the document 
information managed by the server apparatus is rescaled 
based on the base character size intended by the user, 
5 thereby arbitrarily constructing the environment of the 
image processing system capable of easily obtaining the 
optimum output of document information of a layout with 
the character size according to the taste of various 
generations from the aged persons to children. 

10 Fourth embodiment 

Fig. 24 is a flow chart showing the details of 
formatting process shown in the step S2203 in Fig. 20, 
namely the layout process to the physical page in the 
physical layout processor 1107. 

15 In the following there will be explained the 

difference from the foregoing embodiments. In the 
following there will be explained a case where the 
minimum font size is selected as the font size 
information. More specifically, the minimum character 

20 size and the character to which the minimum font size 
is applied are recognized in the document data 
described with the structured description language. 
Based on the recognized minimum character size and the 
font size designated by the predetermined instruction 

25 means, the layout is executed by varying the font size 
of the character information contained in the document 
data, so as to output the character or character train. 



to which the minimum character size is applied, with 
thus desigsnated font size. 

At first a step S2401 searches the document data 
from the start thereof, thereby detecting character 
5 data and calculating the character size upon each 
detection, and a step S2402 stores thus calculated 
character size. Then a step S2403 discriminates 
whether all the document data have been searched, and 
the process of the steps S2401 to S2402 is repeated 
10 until all the search has been completed, thereby 

completing a list of the character sizes used in the 
document . 

In case the step S2403 identifies that all the 
document data have been searched, the sequence proceeds 

15 to a step S2404 to recognize the minimum character size 
min from the stored list of the character sizes. Then 
a step S2405 calculates a magnification rate when the 
detected minimum character size is assumed to be 8 
points. The output font size of 8 points is entered 

20 from the operation panel 1012 of the printer 1000. It 
may also be entered by a graphical user interface (to 
be explained later in Fig. 42) of the image displayed 
on the CRT 10 of the host computer and through the 
network and the input unit 18 of the printer and stored 

25 for example in the RAM 19. As this magnification rate 
is used as the base of the physical layout, a step 
S2406 utilizes this magnification rate in executing the 
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allotment to the physical pages starting from the top 
of the document . 

Then a step S2407 discriminates whether the 
allotment to the physical pages has been completed for 
5 all the document data, and the allotment process of the 
step S2406 is repeated until the completion of the 
allotment . 

In the following there will be shown a specific 
example of the formatting process shown in Fig. 24. 

10 For example 6, 8 and 10 points are listed by the steps 
S2401 to S2403 as the character sizes used in 
thedocument, the step S2404 detects 6 points as the 
minimum character size min. Then the step S2405 
calculates a magnification rate of 8/6 for obtaining a 

15 character size of 8 points. Thus, other listed 

character sizes of 8 and 10 points are allotted to the 
physical page with the respective sizes of 8 x (8/6) 
and 10 x (8/6) points. Not only the characters but 
also other figures (objects) such as a table or a 

20 border line are allotted to the physical page by 
multiplying such magnification rate 8/6. 

In the following there will be shown a specific 
example of the result of formatting process in the 
present embodiment. Fig. 27 shows an example of the 

25 input document data described by HTML, and such 

document data are converted by the formatting process 
of the present embodiment into a configuration capable 
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of page layout as shown in Fig. 29. Also Fig. 28 shows 
the result of actual printing of the document data 
shown in Fig. 29. 

In the present example, since the size of the 
5 smallest character ("table 1") in Fig. 27 is 4 points, 
the magnification rate is calculated as 8/4 = 2. 
Therefore, if the size of the title characters 
("Sample") in Fig. 27 is 14 points and the base font 
size for other characters ("This document .... web 

10 browser") is 6 points. Fig. 29 indicates that the 
conversion is so made as to obtain the title of a 
character size of 28 points, other characters of a size 
of 12 points and the minimum character size of 8 
points. Also since this magnification rate (2 times) 

15 is applied to a table object, the table is allotted to 
the pages in a two -divided form. 

In the present embodiment, as explained in the 
foregoing, at the formatting of the structured 
description language, the physical layout is achieved 

20 based on the minimum character size which is font size 
information, thereby enabling appropriate allotment 
into each page. 

The calculation of the aforementioned 
magnification rate has been explained by a case of 

25 enlarging the minimum character size, detected in the 
structured description language, to 8 points, but the 
present invention is not limited to limited to such 



case but is applicable also to a case of calculating 
the magnification rate for enlargement to other sizes . 

Also in case of determining the character size 
based on the calculated magnification rate, there may 
5 be employed not only the mere multiplication of the 

magnification rate but also an optimizing process such 
as rounding to an appropriate point number (namely a 
point number normally utilized in the system) . 
Fifth embodiment 
10 In the following there will be explained a fifth 

embodiment of the present invention, by the differences 
thereof . 

In the foregoing first embodiment, there has been 
explained a case of recognizing and utilizing the 

15 minimum character size as the font size information set 
in advance or in an interactive manner. Also the 
second embodiment is featured by a fact that the base 
value is set according to the maximum width of the 
object. The object means a drawn figure other than a 

20 character and corresponds to a table or an image in the 
HTML document. 

Fig. 25 is a flow chart showing the formatting 
process in the fifth embodiment. The system 
configuration of the fifth embodiment, and the main 

2 5 sequence and drawing process in the printing operation 
thereof are similar to those in the aforementioned 
fourth embodiment and will not, therefore, be explained 
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further. In the following there will only be explained 
the differences from the foregoing embodiments . 

At first a step S2501 searches the document data 
from the start, looking for an object other than the 
5 characters. For example, in case of HTML, there can be 
searched a tag suchas " < TABLE > " OR ,, <img>" . 

Then a step S2502 calculates the width of the 
detected object. For example, if the object is a 
table, the width can be calculated according to the 
10 width information designated in such table or a 

character size described in the table. Also in case of 
an image, the width can be calculated from the image 
information described in the header of the data format. 
Then a step S2503 discriminates whether the search 
15 has been completed for all the document data, and the 
process of the steps S2501 to S2502 is repeated until 
the search is completed, thereby completing a list of 
the widths of the objects used in the document. 

In case the step S2503 identifies that all the 
20 document data have been searched, the sequence proceeds 
to a step S2504 to detect the maximum object width max 
from the stored list of the object widths. Then a step 
S2505 compares the detected object width max with the 
width of the page. The page width means the physically 
25 printable length in the recording sheet in the main 
scanning direction. 

If the maximum object width max does not exceed 
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the page width, the sequence proceeds to a step S2507 
for setting the reduction rate at 1 . On the other 
hand, if the maximum object width max is larger than 
the page width, the sequence proceeds to a step S2506 
5 for calculating the reduction rate in case the maximum 
object width max is regarded as the page width. The 
reduction rate thus determined is used as the base for 
the physical layout, and a step S2508 executes the 
allotment to the physical pages in succession from the 

10 start of the document, utilizing such reduction rate. 
Then a step S2509 discriminates whether the 
allotment to the physical pages has been completed for 
all the document data, and the allotment process of the 
step S2508 is repeated until the process is completed. 

15 In case of document data not provided with non- 

character object, namely consisting solely of 
characters, the step S2501 does not detect any object. 
In such case, the allotment to the physical page is 
executed by setting thereduction rate is, though such 

20 step is not particularly shown in the flow chart in 
Fig. 25. For this purpose, there may be provided a 
step of setting the maximum object width max at the 
minimum value (for example 0) in case the step S2501 
does not detect the object. 

25 In the following there is shown a specific example 

of the formatting process shown in Fig. 25. For 
example, if the steps S2501 to S2503 list 2000 and 5000 
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dots as the object widths used in the document, the 
step S2504 detects 5000 dots as the maximum object size 
max. On the other hand, in case of using an A4- sized 
recording sheet with a printer resolution of 600 dpi, 
5 the page width is 4720 dots in case such recording 

sheet is conveyed longitudinally. Thus the step S2505 
identifies that the maximum object size max (5000) is 
larger than the page width (4720), so that the step 
S2506 calculates the reduction rate as 4720/5000. The 

10 allotment to the physical page is executed by applying 
such reduction rate not only to the objects but also to 
the characters . 

In the following there will be explained a 
specific example of the result of formatting process in 

15 the fifth embodiment. By applying the formatting 
process of the second embodiment on the HTML input 
document data of the foregoing fourth embodiment shown 
in Fig. 27, there can be obtained a conversion result 
as shown in Fig. 30. The result of actual printing of 

20 the document data shown in Fig. 30 is shown in Fig. 31. 
As shown in Figs. 30 and 31, a table constituting an 
object of the maximum width is appropriately allotted 
in the page and the character size is made smaller than 
in the fourth embodiment shown in Fig. 28. 

25 As explained in the foregoing, the fifth 

embodiment enables, at the formatting of the structured 
description language, appropriate allotment in the page 
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by physical layout based on the maximum object width. 
Sixth embodiment 

In the following there will be explained a sixth 
embodiment of the preseent invention. 
5 The third embodiment is featured by a fact that 

the most frequent font size, which is the character 
size having the highest frequency of use, is used for 
setting the base value of the physical layout 
constituting the font size information that can be set 

10 in advance or in interactive manner. 

Fig. 26 is a flow chart showing the formatting 
process in the sixth embodiment . The system 
configuration of the sixth embodiment, and the main 
sequence and drawing process in the printing operation 

15 thereof are similar to those in the aforementioned 

fourth embodiment and will not, therefore, be explained 
further . 

At first a step S2 601 searches the document data 
from the start, and calculates the character size upon 

20 detecting character data, and a step S2602 counts and 
stores the number of characters for each character 
size. Then a step S2603 discriminates whether the 
search has been completed for all the document data, 
and the process of the steps S2601 to S2602 is repeated 

2 5 until the search is completed, thereby completing a 
list of the character sizes and the number of 
characters used in the document . 
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In case the step S2603 Identifies that all the 
document data have been searched, the sequence proceeds 
to a step S2604 to detect the most frequent character 
size freq having the largest number of characters, from 
the stored list of the sizes. Then a step S2605 
calculates the magnification rate in case the 
recognized most frequent character size freq is 
regarded as 10 points. The magnification rate thus 
determined is used as the base for the physical layout, 
and a step S2606 executes the allotment to the physical 
pages in succession from the start of the document, 
utilizing such magnification rate. 

Then a step S2607 discriminates whether the 
allotment to the physical pages has been completed for 
all the document data, and the allotment process of the 
step S2606 is repeated until the process is completed. 

In the following there will be shown a specific 
example of the formatting process shown in Fig. 26. 
For example, if the steps S2601 to S2603 list 10 
characters of 8 points, 400 characters of 10 points and 
8 characters of 20 points as the character sizes used 
in the document, the step S2604 detects 10 points as 
the most frequent character size freq. Then the step 
S2605 calculates the magnification rate as 10/10 (= 1) 
for obtaining the characters of 10 points. Therefore, 
other listed character sizes of 8 and 20 points are 
allotted also to the physical pages . The allotment to 
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the physical page is executed by applying such 
magnification rate (1 in the above -described example) 
not only to the figures (objects) but also to the 
characters . 

5 In the following there will be explained a 

specific example of the result of formatting process in 
the sixth embodiment . By applying the formatting 
process of the sixth embodiment on the HTML input 
document data of the foregoing fourth embodiment shown 

10 in Fig. 27, there can be obtained a conversion result 
as shown in Fig. 31. The result of actual printing of 
the document data shown in Fig. 30 is shown in Fig. 33. 

In this example, since the base font size for the 
most frequent character size ("This document .... web 

15 browser.") shown in Fig. 27 is set at 6 points as 

explained in the foregoing, the magnification rate is 
calculated as 10/6. Thus, since the title characters 
("Sample") in Fig. 27 has a size of 14 points while the 
smallest characters ("table 1") has a size of 4 points, 

20 the conversion in Fig. 31 is executed in such a manner 
that the most frequent character size becomes 10 
points, the title characters have a size of 14 x 10/6 = 
23.33 (23) points and the smallest characters have a 
size of 4 x 10/6 = 6.66 (7) points. This magnification 

25 rate (10/6) is applied also to the table object of the 
largest width whereby the table is barely allotted in 
the page as shown in Fig. 33. 
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As explained in the foregoing, the sixth 
embodiment enables appropriate allotment within the 
page by executing physical layout based on the most 
frequent character size at the formatting of the 
5 structured description language. 

Also the calculation of the magnification rate in 
the present embodiment is not limited, as in the first 
embodiment, to the case of enlarging the detected most 
frequent character size to 10 points but is likewise 
10 applicable to the enlargement to other sizes. Also the 
conversion of the character size may be executed not 
only by the multiplication of the magnification rate 
but also by an optimizing process such as rounding to a 
suitable number of points . 
15 Seventh embodiment 

In the foregoing embodiment, the magnification 
rate is calculated for the entire page by recognizing 
the character size or the maximum width of the object. 
In the present embodiment, there will be explained, 
20 with reference to Figs. 34 to 39, an example of 

employing different magnification rates respectively 
for the character and the object. 

In Fig. 34, there are shown process steps S3401 to 
S3408. In the present embodiment, the main process 
25 from the start of the operation of the printing 

apparatus to the end thereof and the drawing process 
therein are similar to those in the foregoing 
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embodiments and will not, therefore, be explained 
further, and there will only be explained the 
difference between the present embodiment and the 
foregoing embodiments. In the present embodiment, 
5 there will be explained a case of recognizing the 
minimum character size and calculating the 
magnification rate thereon as explained for example in 
the fourth embodiment (shown in Fig. 24), but the 
magnification rate may also be calculated from the 

10 character size by recognizing the size of the most 
frequent character as shown in Fig. 26. In the 
following there will be explained the difference from 
the foregoing embodiments. 

Fig. 34 shows the formatting process employed in 

15 Fig. 24 and constituting a layout process to the 
physical page. 

At first, a step S3401 searches the document data 
from the start and calculates the character size upon 
detection of character data. Then a step S3402 

20 calculates a magnification rate (hereinafter called 

base magnification rate, base-mag) in case the detected 
character size is regarded as 8 points. The base 
magnification rate is basically applied to all the 
drawing process for character, figure and image, and 

25 for example becomes 8/6 in case the maximum character 
size detected in the step S3401 is 6 points. It is 
explained "basically" applicable since it is changed to 
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a specified magnification rate in case of figure/image 
processing, which will be explained later. After the 
calculation of the base magnification rate, a step 

53403 analyzes the content of the document description 
5 from the start of the document. If the analyzed 

description indicates character drawing (step S3404), 
the sequence proceeds to a step S3405 for executing the 
layout to the physical page after multiplying the 
character size and the character pitch with thebase 
10 magnification rate. On the other hand, if the step 

53404 identifies that the analyzed description does not 
indicate the character drawing, the sequence proceeds 
to a step S3406 for discriminating whether it indicates 
figure/image drawing. In case of figure/image drawing, 

15 the sequence proceeds to a step S3407 for executing a 
figure/image process. The process of the steps S3403 
to S3407 is repeated until the analysis of all the 
document and the allotment thereof to the physical 
pages are completed (step S108). 

20 Fig. 35 shows a figure/image process corresponding 

to the step S3407 in Fig. 34. This process is to allot 
a figure or an image to the physical page. In the 
following, the figure and image are collectively called 
an object. 

25 At first a step S3501 calculates the width of an 

object. The width of the object can be calculated, in 
case of a table, from the width information designated 
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in the table or from the size of the character 
described in the table, and, in case of an image, from 
the image information described in the header of the 
data format. Then a step S3502 calculates the right - 
5 hand end of the object (obj -right) by multiplication of 
the base magnification rate calculated in the step 
S3402 shown in Fig. 34. More specifically, the right- 
hand end of the object can be determined by multiplying 
the sum of the drawing start position of the object and 

10 the width of the object with the base magnification 
rate. Then a step S3503 discriminates whether the 
right-hand end of the object is larger than the right- 
hand end of the page (page-right), namely whether the 
object overflows from the right-hand end of the page. 

15 If the object overflows from the right-hand end of the 
page, the sequence proceeds to a step S3504 for 
calculating the magnification rate (obj-mag) when the 
right-hand end of the object is set at the right-hand 
end of the page. More specifically, the obj-mag can be 

20 obtained by dividing the difference between the right- 
hand end of the page and the drawing start position of 
the object by the width of the object. On the other 
hand, if the step S3502 identifies that the object does 
not overflow from the right-hand end of the page, a 

25 value 1 is set in the obj-mag. Finally, a step S3505 
executes allotment to the physical page by scaling the 
object with the obj-mag. Thus, in case the figure or 
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image overflows from the sheet with the magnification 
rate calculated from the character size, the 
magnification rate is individually changed only for the 
figure and the image, thereby placing such figure and 
5 the image forcedly within a page and avoiding output 
with the figure or image in a broken form. In this 
manner there can be attained pleasant page layout . 

Specific examples of the present embodiment are 
shown in Figs. 37, 38 and 39. 

10 Fig. 37 shows a document displayed by the web 

browser, and Fig. 38 shows the result of printing of 
the document shown in Fig. 37 by the printing 
apparatus. In the document shown in Fig. 37, the image 
data are pasted among the character trains. Fig. 38 

15 shows an example of the print obtained by applying a 
magnification rate determined in consideration of the 
character only. In the method of applying the 
magnification rate to all the objects as in the fourth, 
fifth or sixth embodiment, there may result an overflow 

20 from the page as shown in Fig. 38. On the other hand, 
the layout process of the present embodiment allows to 
accommodate the image data within the page even when 
the characters are enlarged as shown in Fig. 39, 
thereby providing a pleasant -looking output. 

25 Eighth embodiment 

In contrast to the seventh embodiment in which the 
magnification rate for the object is calculated only in 



case of overflowing from the page, the present 
embodiment designates in advance bases respectively to 
the character and the object thereby enabling external 
control of the magnification rate, as will be explained 
5 in the following with reference to Fig. 36. In the 

following there will be explained the difference from 
the foregoing embodiment . 

In Fig. 36, there are shown process steps S3601 to 
S3608. In the present embodiment, the main process 
10 from the start of the operation of the printing 

apparatus to the end thereof and the drawing process 
therein are similar to those in the foregoing 
embodiments and will not, therefore, be explained 
further . 

15 Fig. 40 shows an example of the reference print 

instruction in the present embodiment. The items 
contained therein are already explained in the 
foregoing embodiments, but the example shown in Fig. 40 
designates an object magnification rate <object-mag> in 

20 addition to the standard font size. The <object-mag> 
small means that a "smaller" magnification rate is 
designated for the object. 

Fig. 36 shows a formatting process shown in Fig. 
24 and corresponding to a layout process to the 

25 physical page. At first a step S3601 calculates the 

character base magnification rate ( CHR • base-mag ) . The 
calculation method therefor is same as explained in the 
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foregoing embodiment and will not, therefore, be 
explained further. In case of the designation shown in 
Fig. 7, the object base magnification rate (object 
base-mag) is calculated by multiplying the character 
5 base magnification rate with 3/4. The value 3/4 is 

retained in advance for "small", and other values are 
also retained one-to-one to specified character trains, 
for example "middle" = 1 and "big" = 4/3. After the 
calculation of the character base magnification rate 

10 and the object base magnification rate, a step S3603 
analyzes the content of the document description from 
the start of the document. If the analyzed description 
indicates character drawing (step S3604), the sequence 
proceeds to a step S3605 for executing the layout to 

15 the physical page after multiplying the character size 
and the character pitch with the base magnification 
rate. On the other hand, if the step S3604 identifies 
that the analyzed description does not indicate the 
character drawing, the sequence proceeds to a step 

20 S3606 for discriminating whether it indicates 

figure/image drawing. In case of figure/image drawing, 
the sequence proceeds to a step S3607 for executing 
allotment to the physical page by multiplying the 
drawing position, width and height with the object base 

25 magnification rate. The process of the steps S3603 to 
S3607 is repeated until the analysis of all the 
document and the allotment thereof to the physical 
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pages are completed (step S3608). 

A specific example of the present embodiment is 
shown in Fig. 41. 

Fig. 41 shows the result of printing in the 
present embodiment of the document shown in Fig. 37, 
wherein the characters are magnified by 8/6 times in 
the layout, while the magnification of the image is 
(8/6) x (3/4) = 1. 
Ninth embodiment 

In the following there will be explained a ninth 
embodiment of the present invention. 

The ninth embodiment is featured in that there is 
arbitrarily selectable any of the formatting processes 
shown in the foregoing fourth to eighth embodiments or 
a part thereof. More specifically, the system 
configuration, and the main process and drawing process 
in the printing operation in the fifth embodiment are 
similar to those in the fourth embodiment, but the base 
value for physical layout in the formatting process can 
be selected according to any of the minimum character 
size, the maximum object width or the most frequent 
character size. 

More specifically, the user is rendered capable of 
selecting, on the operation panel 1012 of the printer 
1000, one of the above-mentioned three methods as the 
reference value for formatting, namely one of the 
layout methods respectively corresponding to the fourth 
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to sixth, embodiments. Fig. 42 shows an example of such 
embodiment. Fig. 42 shows a part of the image to be 
displayed on the operation panel 1012 and constituting 
a font size designation unit 4200 for designating the 
5 font size. This image may also be displayed on the CRT 
of the host computer connected to the printer through 
the network. It is also possible to designate the font 
size with a mouse or a keyboard, on the CRT of the host 
computer and to enter thus designated font size to the 

10 font size input unit of the printer. 

An OK button 4201 is depressed upon completion of 
the designation of the font size, thereby rendering 
such designation effective. A cancel button 4202 
cancels the designation of the font size. Selection 

15 means 4203, 4204, 4209 are used for selecting a 

character or a character train to be subjected to the 
font size designation. A font size designating field 
4205 for entering the font size selected by the 
selection means 4203, 4204 (the smallest font size 

20 being selected in the illustrated example). In this 
manner there is selected the font size information 
contained in the structured document for determining 
the font magnification. Upon selection of 4209, the 
output is made with the font size designated by 4205, 

25 regardless of the applied font size information. 

Buttons 4206, 4207, 4208 are used for changing the base 
font. For example a button 4206, shown as "big" 
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changes the font size of the defined style sheet to a 
large size. Thus the character train, to which applied 
is the style sheet defining the base font size, is 
outputted with a relatively large predetermined base 
5 font size. However, there is not influenced a portion 
which is excluded from the application of the base font 
size defined by the style sheet and to which the font 
size is designated individually. On the other hand, 
the minimum font size is designated as 12 points in the 

10 font size designating field, and the output is made 
with the minimum font size at 12 points or larger 
regardless of the style sheet. In this manner there 
can be obtained an image securely legible to the aged 
persons regardless whether the style sheet is applied 

15 or not in the structured document. 

The operability can be improved further by a 
configuration in which the result of formatting based 
on the selected base value can be previewed in the unit 
of a page on the CRT 10 connected to the host computer. 

20 As explained in the foregoing, the ninth 

embodiment enables formatting desired by the user. For 
example, it is possible, for the same document data 
described by HTML, to select the output form as shown 
in Fig. 28, 32 or 33. 

25 In the foregoing there have been explained 

examples of calculating the character size by the 
number of points, but the present invention is 
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applicable also to a document in which the character 
size is represented by other representations (for 
example big/middle/ small) , by retaining the ratios of 
such sizes (big/middle/small) in advance. 
5 Also in the foregoing embodiments, the document 

data to be subjected to formatting are assumed to be 
described by HTML, but the present invention is not 
limited to such case and is naturally applicable to 
other structured description languages such as XML or 
10 SCGML. 

The present invention is applicable to a system 
consisting of plural equipment (for example host 
computer, interface device, reader, printer etc.) or an 
apparatus consisting of a single equipment (for example 

15 copying apparatus, facsimile etc.). 

The objects of the present invention can naturally 
be attained also by supplying a system or an apparatus 
with a memory medium (or recording medium) storing 
program codes of a software realizing the functions of 

20 the aforementioned embodiments and by reading and 

executing the program codes stored in the memory medium 
by a computer (or CPU or MPU) of such system or 
apparatus. In such case, the program codes themselves 
read from the memory medium realize the functions of 

25 the aforementioned embodiments and the memory medium 
storing the program codes constitutes the present 
invention. The present invention further includes not 
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only a case where the functions of the aforementioned 
embodiments are realized by the execution of the read 
program codes by the computer but also a case where an 
operating system or the like functioning on the 
5 computer executes all the processes or a part thereof 
under the instruction of the program codes, thereby 
realizing the functions of the aforementioned 
embodiments . 

In such case, the program codes themselves read 

10 from the memory medium realize the functions of the 
aforementioned embodiments and the memory medium 
storing the program codes constitutes the present 
invention. The memory medium for supplying the program 
codes can be, for example, a floppy disk, a hard disk, 

15 an optical disk, a magnetooptical disk, a CD-ROM, a CD- 
R, a magnetic tape, a non -volatile memory card, a ROM 
or an EEPROM. 

The present invention further includes not only a 
case where the functions of the aforementioned 

20 embodiments are realized by the execution of the read 
program codes by the computer but also a case where an 
operating system or the like functioning on the 
computer executes all the processes or a part thereof 
under the instruction of the program codes , thereby 

25 realizing the functions of the aforementioned 
embodiments . 

The present invention further includes a case 
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where the program codes read from the memory medium are 
once stored in a memory provided in a function 
expansion board inserted into the computer or a 
function expansion unit connected thereto and a CPU or 
5 the provided on the function expansion board or the 

function expansion unit executes all the processes or a 
part thereof under the instruction of the program 
codes , thereby realizing the functions of the 
aforementioned embodiments. 

10 The functions of the embodiments shown in Figs. 9 

to 13, 17 and 20 may be realized by the host computer 
by an externally installed program. The present 
invention is applicable also in a case where a group of 
information including a program is supplied by a memory 

15 medium such as a CD-ROM, a flush memory or an FD or by 
an external memory medium through a network. 



